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CIRCUIT AND METHOD FOR INTERLEAVING A DATA STREAM 

Background of the Invention 



5 The present invention relates in general to 

integrated circuits/ and more particularly to 
integrated circuits for interleaving data contained in 
different sections of a multimedia data stream. 

Digital Versatile Disks and other devices are 

10 frequently used to store video and audio, i.e., 

multimedia, data for displaying on a monitor or driving 
speakers. The multimedia sounds and images typically 
are intended to be produced at the same time, but the 
data used to generate them may be provided serially. 

15 Therefore, it is often necessary to interleave 

data contained in different sections of the serial data 
stre'am to allow the different sections to be processed 
together. For example, in the multimedia formatting 
standard known as the Motion Picture Expert's Group 1 

20 (MPEG-1) standard, the audio portion includes data for 
two audio channels, i.e., stereo, which are interleaved 
within each frame of the incoming data stream and can 
readily be processed together. An extension of MPEG-1 
referred to as the MPEG-2 standard expands this concept 

25 to include additional channels of surround sound 

capability to provide up tp eight channels of audio 
data. To ensure backward compatibility with the 
earlier MPEG-1 standard, MPEG-2 provides stereo data 
within one section of the data stream and surround 

30 sound data within a different section which is received 
later . 

Prior art audio processing circuits use a large 
memory circuit with up to 26,000 memory cells to store 
the audio data stream from the stereo section up to and 
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including the surround sound data. To avoid 
interrupting the output signal due to data not being 
available, the memory circuit is configured as a dual 
port memory which can be written to and read from 
5 simultaneously. However, such dual port memories 

consume a large die area on an integrated circuit and 
therefore increase the manufacturing cost of the 
processing circuit . 

Hence, there is a need for an improved circuit and 
10 method of retaining data from one section of a 

multimedia signal so that the data can be processed 
together with data from another section that is 
received later in a serial data stream. 

15 Brief Description of the Drawings 

FIG. 1 is a diagram of a frame of MPEG-2 audio 

data; 

FIG. 2 is a block diagram of a multimedia data 
20 processing circuit; and 

FIG. 3 is a block diagram of an audio processor. 

Detailed Description of the Drawings 

25 A simplified frame of a typical audio portion of 

an MPEG-2 data stream is shown in FIG. 1, including a 
stereo section containing control information in HEADER 
1 along with stereo data for stereo CHANNELS Tl and T2 . 
The stereo section is followed by a surround sound 

30 section containing control information in HEADER 2 

along with surround sound data for CHANNELS T3, T4 and 
T5. Because the stereo and surround sound output 
signals are intended to be heard at the same time, they 
must be processed together, even though surround sound 
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data is received later than stereo data. Moreover, the 
processing must occur continuously and without pauses 
to provide high quality audio output signals to drive 
the speakers or other output devices. 
5 FIG. 2 is a block diagram of a multimedia data 

processing circuit 10 for converting a multimedia data 
stream DATA to a video signal for driving a monitor 22 
or other display device, and an audio signal for 
driving a speaker 24 or other audio device. To 

10 simplify the description, data processing circuit 10 is 
shown as having one speaker, although there typically 
is one speaker for each channel of audio data produced 
by data processing circuit 10. DATA is compressed and 
formatted in accordance with the Motion Picture 

15 Expert's Group 2 (MPEG-2) standard as shown in FIG. 1. 

Multimedia data processing circuit 10 includes a 
data flow circuit 26 which receives DATA in serial 
fashion on a 32-bit input bus 30 from a Digital 
Versatile Disk or other input device. DATA is sorted 

20 into video and audio portions which are stored in 

serial fashion in separate regions of a buffer storage 
circuit 28, which includes a large dynamic random 
access memory (DRAM) to store several frames of data. 
Data flow circuit 26 tracks the locations of the video 

25 and audio regions with pointers to control and monitor 
transfers of DATA on a 32-bit data bus 38 in response 
to memory requests from a video processor 34 and an 
audio processor 36 sent on a control bus 40. 

Video processor 34 receives the video portion of 

30 DATA from buffer storage circuit 28 on a thirty-two 

bit bus 38 for decompressing and other video processing 
such as color correction, pixel interpolation, etc. 
Where the monitor is configured to receive an analog 
video signal, video processor 34 includes circuitry to 
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convert the digital video data to an analog video 
signal and to amplify the analog video signal. 

As video data is processed and the video image is 
displayed on monitor 22, a request for new data is sent 
5 to data flow circuit 26 on bus 40 . However, data flow 
circuit 26, buffer storage circuit 28 and bus 38 are 
not always available to respond to such requests 
immediately to ensure a continuous and uninterrupted 
supply of video data to video processor 34. For 

10 example, data flow circuit 26 and/or bus 38 may be busy 
performing other system tasks such as receiving new 
DATA, transferring audio data to audio processor 36 or 
communicating with other system devices (not shown) 
coupled to bus 38. To avoid interruptions in the video 

15 output signal that drives monitor 22, video processor 
34 includes local memory to absorb such periods when 
data is not immediately available to allow video 
processing to continue for a time. 

Similarly, audio processor 36 decompresses the 

20 audio portion of DATA received from data flow circuit 
26 on bus 38. Audio data is formatted to include 
surround sound audio channels, so audio processor 36 
interleaves stereo channels T1-T2 with surround sound 
channels T3-T5 to drive speaker (s) 24. Audio processor 

25 34 includes circuitry to perform a digital-to-analog 

conversion on the audio data and to amplify and filter 
the converted analog audio signal if necessary. 

As audio data is processed, audio processor 36 
issues a request for new data to data flow circuit 26 

30 on control bus 40. As is the case with video data, if 
data flow circuit 26 and/or bus 38 are occupied with 
other system tasks, new audio data often is not 
immediately transferred on demand. To ensure that 
speaker 24 is driven with an uninterrupted audio 
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signal, audio processor 36 includes local memory to 
store enough audio data to ensure continuous processing 
for the periods when data flow circuit 2 6 and bus 38 
are unavailable to transfer new audio data. 
5 While data for one circuit is being transferred so 

that data flow circuit 26, buffer storage circuit 28 or 
bus 38 are busy, other circuits must wait until the 
transfer is complete. Hence, the size of the local 
memory in video processor 34 and audio processor 36 is 

10 determined by the amount of data transferred to other 
circuits. To reduce wait states, local memory 
typically is configured as dual port random access 
memory. However, dual port random access memory 
consumes a large area on an integrated circuit die and 

15 consequently increases system cost, so it is desirable 
to either reduce the size of data transfers or to 
reduce the amount of local memory needed to absorb the 
wait states. 

FIG. 3 is a schematic diagram showing further 

20 detail of audio processor 34 for decoding and 

processing audio data received on bus 38 to produce a 
continuous audio signal to drive speaker 24. Audio 
processor 34 includes memory circuits 62 and 64, a 
memory control circuit 66, a multiplexer 68, a 

25 decompression circuit 70 and audio circuitry 72. 

Memory circuits 62 and 64 are configured as dual 
port memories capable of providing stored data to their 
respective outputs while receiving and writing new data 
from bus 38. Memory circuits 62 and 64 have adequate 

30 storage capacity to absorb the worst case wait states, 
i.e., to retain enough data to ensure continuous audio 
processing while waiting for new audio data to be 
received. Stereo data (T1-T2) from buffer storage 
circuit 28 is routed through memory circuit 62 and 
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surround sound data (T3-T5) is routed through memory 
circuit 64. Since this data is available in buffer 
storage circuit 28, it can be transferred in small 
packets as it is processed, rather than as a complete 
5 frame. By using two memory circuits 62 and 64 and 
avoiding the need to store an entire frame of audio 
data, the present invention can use smaller memory 
circuits than the prior art. 



10 circuits 62 and 64 include about 1,000 bits of storage 
capacity, a significant reduction from the 26,000 bits 
needed by the prior art. The smaller memory size 
significantly reduces die area and circuit 
manufacturing cost . 

15 Memory control circuit 66 controls data transfers 

into and out of memory circuits 62 and 64 with 
read/write lines 80 and 82. Memory control circuit 66 
includes a pointer to monitor the amount of stereo data 
currently stored in memory circuit 62, which is 

20 incremented when new stereo data is received and 

decremented when data is provided at the output of 
memory circuit 62 and selected through multiplexer 68. 
A similar surround sound pointer tracks the amount of 
surround sound data currently being stored in memory 

25 circuit 64. The surround sound pointer increments and 
decrements when surround sound data is transferred into 
or out of memory circuit 64, respectively. When the 
amount of data stored in memory circuits 62 or 64 falls 
below a predetermined level, memory control circuit 66 

30 sends a request on bus 40 to data flow circuit 26 for 
new stereo or surround sound data. 

Multiplexer 68 selects between memory circuit 62 
and memory circuit 64 in response to a selection signal 
from decompression circuit 70 to produce an interleaved 



For example, in the described embodiment, memory 
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signal at its output. By way of example, suppose that 
decompression circuit 70 needs a packet of T1-T2 data 
followed by a packet of T3-T5 data to decompress the 
audio data stream. Decompression circuit 70 produces a 
5 first selection signal at the control input of 

multiplexer 68 to route a T1-T2 packet stored in memory 
62 to the output of multiplexer 68. Decompression 
circuit 70 then produces a second selection signal to 
route a T3-T5 packet stored in memory 62 to the output 
10 of multiplexer 68 in a sequence T1-T2, T3-T5, etc. 
Hence, a T1-T2 packet is interleaved with a T3-T5 
packet . 

Stereo and surround sound data typically are 
selected and decompressed in packets according to the 

15 algorithm used in decompression circuit 70, rather than 
as individual alternating bits. Therefore, data stored 
in memory circuit 62 may be processed at a different 
rate from data stored in memory circuit 64. As stereo 
or surround sound data is selected through multiplexer 

20 68, decompression circuit 70 sends a control signal to 
memory control circuit 66 to decrement the appropriate 
pointer to update the amount of data currently stored 
in memory circuits 62 and 64. 



25 decompresses the audio data to provide a decompressed 

audio data stream at output 84. The decompressed audio 
data stream is applied to audio circuitry 72 for 
further processing such as decoding into the two stereo 
and three surround sound channels, converting to analog 

30 audio signals, amplifying, filtering and the like. The 
five-conductor output of audio circuitry 72 drives 
speaker 24 and/or other audio devices (not shown) . 

By now it should be appreciated that the present 
invention provides a circuit and method of interleaving 



In this fashion, decompression circuit 70 
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a data stream in which the data to be interleaved is 
contained in separate sections of the data stream. A 
buffer storage circuit receives and stores the data 
stream. A first section of the data stream is 
5 transferred to a first memory circuit and a second 

section of the data stream is transferred to a second 
memory circuit. A multiplexer circuit having first and 
second inputs respectively coupled to the outputs of 
the first and second memory circuits selects between 
10 the first and second sections of the data stream in 
response to a selection signal to produce an 
interleaved output signal. 
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